12 - Projective Reconstruction of CT Acquisition Geometry Without Point Correspondences [ID:12845]
50 von 105 angezeigt

Thank you for the introduction. So, starting off, so I joined the lab in May 2016 and it's

the 6th PIF, meanwhile, if you don't count the CT reconstruction workshop. Now, since last time

a few things got published, notably for this one archive paper, which I consider a valid publication

because we won a prize on it, and my medical physics paper about the beam hardening correction,

and a paper at ICCV, which I will talk about in the following 10 minutes. Now, I have submitted

another paper which will also be part of this talk. It's the projective reconstruction for

out-point correspondences, and I currently prepare a larger work on all my research in the past years,

which you can find over here. So, what am I talking about about acquisition geometry? What

is this? So, for CT reconstruction, we need raw data which we measure, but what we also need is

calibration data on the geometry of our CT system, and that calibration data specifies how our operator

which we need to invert is actually built up. So, this geometry is usually built up by projection

matrices and specifies how source and detector move. Now, if we don't get this calibrated data

right, like there can be two cases which is this curse, for example, there's involuntary patient

motion, you can see that our reconstruction which should look like this will get degraded by

artifacts like streaking artifacts which you see on the right side. Now, this is not only about

patient motion, it is also about non-reproducible scanner trajectories. So, if your scanner which

you calibrate is not able to reconstruct, so to use the same trajectory again, you get the same

problems. Both artifacts are in the end caused by your projection matrix not matching your

projection data. Now, if you look to a related field which is the field of computer vision,

we can actually find that, for example, you see this reconstruction of the coliseum, and they did

this reconstruction based on random images of people who uploaded in on the internet. Now,

they can do this because their algorithms, they often termed like structure for motion,

they estimate the 3D reconstruction and the acquisition geometry at the same time. The

working horse for this to actually work is they establish point correspondences. So,

I sampled two random images from the coliseum and what you can see here is that for some points in

those images, you can actually find corresponding points in other images. Those things are called

point correspondences and those computer vision algorithms rely heavily on them. The reason why

they rely heavily on them is they often use it to build up the relative geometry of projections

in the beginning. So, what you see here is that a corresponding point like X1 here will actually

is the projection of the same 3D point in the 3D reconstruction. Now, there's another thing. So,

if you connect the source of the X-ray projections, you get a thing called the baseline and where

the space line intersects the detectors, there will be the so-called epipoles which I will refer

to later. Now, the epipoles and any point can be used to define a line which is called an epipolar

line. Now, any point has to lie on a corresponding epipolar line in the other projection and this

geometry is fully described by a single matrix called the fundamental matrix. Now, if we want to

apply this to, if we want to transfer this to X-ray images, we started with the problem of like

having to determine corresponding points. Now, I brought you an example here of a phantom. So,

there is some metal beads with the different densities in here and you're now tasked with

finding correspondences. So, some of them are literally impossible because they are in the air,

but even for those it's kind of really, really hard. So, we can apply the computer vision algorithm

and we can estimate a fundamental matrix which gives us this result. Is it correct? Well, I don't

know, but let's look at the ground truth. So, on the left side, the estimated epipolar geometry,

on the right side, the ground truth. So, what you see is it's kind of random result and that's not

surprising because the point matching fails completely. So, that leads me to the topic of

this talk. I want to estimate fundamental matrices without point correspondences. How do I do this? I

refer back to the epipolar geometry which is in before and I've just highlighted the so-called

epipolar plane here. The idea is since we are working in X-ray imaging, what we want to reconstruct

is the 3D distribution of the linear attenuation coefficient. Now, if we think about this epipolar

plane and all the attenuation contained in this plane, if we have an integral over this whole plane

accumulating all the attenuation, it should be the same no matter from which detector we measure all

Teil einer Videoserie :

Presenters

M. Sc. Tobias Würfl M. Sc. Tobias Würfl

Zugänglich über

Offener Zugang

Dauer

00:11:15 Min

Aufnahmedatum

2020-02-18

Hochgeladen am

2020-02-18 14:13:08

Sprache

en-US

Tags

geometry computer reconstruction deep pattern medical problem recognition optimization learning graph projective direction estimating acquisition optimized vision characterize upgrading correspondences viewing implementations modelled
Einbetten
Wordpress FAU Plugin
iFrame
Teilen